Robot system

ABSTRACT

A power-saving robot system includes at least one peripheral device and a mobile robot. The peripheral device includes a controller having an active mode and a hibernation mode, and a wireless communication component capable of activation in the hibernation mode. A controller of the robot has an activating routine that communicates with and temporarily activates the peripheral device, via wireless communication, from the hibernation mode. In another aspect, a robot system includes a network data bridge and a mobile robot. The network data bridge includes a broadband network interface, a wireless command interface, and a data bridge component. The data bridge component extracts serial commands received via the broadband network interface from an internet protocol, applies a command protocol thereto, and broadcasts the serial commands via the wireless interface. The mobile robot includes a wireless command communication component that receives the serial commands transmitted from the network data bridge.

This application is a continuation of U.S. application Ser. No.15/182,849, filed Jun. 15, 2016, which claims priority to U.S.application Ser. No. 14/275,355, filed May 12, 2014, which claimspriority to U.S. application Ser. No. 13/893,905, filed May 14, 2013,which claims priority to U.S. application Ser. No. 12/959,879, filedDec. 3, 2010, which claims priority to is a continuation of U.S.application Ser. No. 11/633,883, filed on Dec. 4, 2006, which claimspriority under 35 U.S.C. 119(e) to a U.S. provisional patent applicationfiled on Dec. 2, 2005, entitled “ROBOT NETWORKING, THEMING ANDCOMMUNICATION SYSTEM” and having assigned Ser. No. 60/741,442, theentire contents of which are hereby incorporated by reference.

TECHNICAL FIELD

This invention relates to robot systems, and more particularly to powersaving robot systems and robot system networks.

BACKGROUND

Autonomous robots are robots which can perform desired tasks inunstructured environments without continuous human guidance. Many kindsof robots are autonomous to some degree. Different robots can beautonomous in different ways. An autonomous coverage robot traverses awork surface without continuous human guidance to perform one or moretasks. In the field of home, office and/or consumer-oriented robotics,mobile robots that perform household functions such as vacuum cleaning,floor washing, patrolling, lawn cutting and other such tasks have beenwidely adopted. Autonomous coverage robot systems that include acoverage robot and peripheral devices are generally battery powered. Asa result, the battery life of each component of the system affects theoperability of the overkill system.

SUMMARY

The present disclosure provides a robot which can communicate with abase station and/or internet site via wireless communications media, inone configuration using a wireless bridge adapted for connectiondirectly to a home wired network to provide a direct presence andproxies for the robot, allowing the robot to be a fully functionalnetwork node.

In one aspect, a power-saving robot system includes at least oneperipheral device to be placed in an environment and a mobile robot. Theperipheral device includes a power supply, a wireless communicationcomponent, and a controller having an active mode in which theperipheral device is fully operative and a hibernation mode in which theperipheral device is at least partly inactive. The wirelesscommunication component is capable of activation in the hibernationmode. The mobile robot includes a drive system that moves the robotabout the environment, a wireless communication component, and acontroller. The controller has an activating routine that communicateswith the peripheral device via the wireless communication components andtemporarily activates the peripheral device from the hibernation modewhen the wireless communication components of the peripheral device andthe robot come within range of one another.

In one implementation, the wireless communication components communicatewith transmission wavelengths that permit the robot and the peripheraldevice to be outside a line of sight. Conversely, in anotherimplementation, the wireless communication components communicate withtransmission wavelengths that require the robot and the peripheraldevice to be within a line of sight. In one example, the peripheraldevice is precluded from altering, modes, from the hibernation mode tothe active mode until a line of sight is present between the robot andthe peripheral device.

The wireless communication components may communicate with apoint-to-point protocol while excluding routing and may communicatecommands interpretable by the peripheral device to initiate a function.In one example, the wireless transmission communicated by the robotwireless communication circuit includes identification information.Similarly, the wireless transmission communicated by the peripheraldevice wireless communication circuit may include identificationinformation as well.

In some implementations, the peripheral device, while in the hibernationmode, occasionally listens for a robot ping. Also, while in thehibernation mode, the peripheral device occasionally polls for a quietrobot. In one example, the peripheral device is a base station. Inanother example, the peripheral device is a mobile device.

In another implementation, the robot measures a signal strength of awireless transmission communicated by the wireless communicationcomponent of the peripheral device to determine a distance from theperipheral device. In one example, the wireless communication componentscommunicate over a radiofrequency.

In some implementations, the controller of the robot determines alocality of the robot based on information received via the wirelesscommunication component of the robot from a peripheral device, such as abeacon located in an area in which the robot is operating. Theperipheral device is configured to transmit radio-frequencyidentification information. For example, each locality within a robotenvironment ma respectively include a beacon configured to wirelesslyemit respective location information (e.g. in an environmentcorresponding to a house, each “locality” may represent a room, and eachroom may be installed with a beacon broadcasting a unique identificationover radio-frequency or other such medium). A base station may beprovided in at least one locality, and the beacon may be configured tocommunicate with the base station and to relay data, therefrom and/orthereto. It is advantageous for such beacons and base stations to saveelectrical power. The beacon may emerge from a low-power “hibernation”intermittently by listening for RF or IR of the robot, by operating awake-up timer, by being actively RF or IR interrogated by the robot, orany permutation of combinations thereof based time elapsed since a lastevent or number or frequency or character of interactions. Furthermore,the robot may activate a peripheral device according to a schedule ortransmit schedule information to the peripheral device, which activatesitself based on the schedule.

In another aspect, a robot system includes a network data bridge and amobile robot. The network data bridge includes a broadband networkinterface, a wireless command interface, and a data bride component. Thebroadband network interface is connectible to an internet protocolnetwork and carries communications transferred in compliance with aninternet protocol. The wireless command interface is connectible to awireless command protocol network and carries communications transferredunder a command protocol. The data bridge component extracts serialcommands received via the broadband network interface from the internetprotocol and applies the command protocol thereto. The data bridgecomponent listens to the narrowband wireless interface and sends arobot, peripheral, network and system state to the Internet via thebroadband network interface. This information is automatically sent to amonitoring service via interact protocols, where long-term monitoringand analysis takes place. Actions/commands resulting from this analysisare injected into the narrowband wireless network by the RF-bridge.These actions can include serial commands, new software images for robotand/or peripheral, or queries for more in-depth (debugging) informationthat can be interpreted and responded to by the robot. The data, bridgecomponent also broadcasts the serial commands via the narrowbandwireless interface. The mobile robot includes a drive system that movesthe robot about an environment and a wireless command communicationcomponent that receives the serial commands transmitted from the networkdata bridge.

In some implementations, the system also includes at least oneperipheral device to be placed in the environment. The peripheral deviceincludes a wireless command communication component that receives serialcommands transmitted from the robot and the network data bridge. Theperipheral device also includes a controller having an active modewherein the peripheral device is fully operative and a hibernation modewherein the peripheral device is at least partly inactive. The wirelesscommunication circuit is capable of activation in the hibernation mode.

In another aspect, the robot can receive and utilize customizable soundsor other audio content for interacting with a user. The robot receivesaudible content and plays back the audible content in coordination withspecific robot functions. In one example, the robot controls externallyvisible indicia of the robot in coordination with a play back of audiblecontent such as, inter alia, synthesized voice content during a userinteraction and/or training mode.

In yet another aspect, the robot includes a facade or external housingchangeable with customized cladding. In one example, the home robotincludes interchangeable molded plastic or metal body panels affixed toan exterior of the robot by snap-on fasteners, insertable fitting tabsand receivers, screws, magnetic fixing pieces, etc. The interchangeablebody panels correlate to audio content uploadable to the robot. In oneinstance, the customized body panel includes an identification systemfor automatically causing the robot to download and/or use thecorresponding audible content. The identification system ma include anintegrated circuit, characteristic resistance, bar code, opticalidentifier, RFID, passive magnetic resonance, or mechanicalidentification system (e.g. a punch-card-like series of holes orprotrusions).

The ability to customize the robot by transferring selected sound ormultimedia schemes, themes, tones, music, audio or visual content,choreographic or movement routines, or other data to the robot improvesoverall enjoyment from the robot by a user. In one aspect, the robotincludes a radio receiver configured to receive audible content viawireless transmission, a memory configured to store the audible content,a speaker configured to emit the audible content, and indiciacontrollable by a controller and configured to indicate operativeinformation in a first mode and to indicate illustrative information incoordination with the audible content in a second mode. The indicia mayinclude a light-emitting diode and also a power indicator configured toindicate an actual power state of the robot in the first mode and atraining pattern in the second mode. The robot may further include avoice synthesizer configured to synthesize spoken didactic informationbased on the audible content. Also, the wireless transmission may bestructured according to a packet-encoded transmission protocol. Therobot may further include a customizable body panel detachably affixedto a main body of home robot, where the customizable body panelcorresponds with themed audio data included in the audible content.

The robot may be configured to operate in at least first and secondmodes. The first mode corresponds to a normal robot operating state ofthe performing a primary function. The second mode corresponds to atraining mode, where the speaker emits an audible training instructionalprogram. In the second mode, the indicia of the robot displays accordingto a training pattern in timed coordination with the audibletraining/instructional program, where the training pattern displayed onthe indicia is different from an operative pattern corresponding to anactual state of the home robot.

In another aspect, a robot system includes a mobile robot and a wirelesscommunication system for communicating with the robot. The wirelesscommunication system includes a network interface unit configured tocommunicably interface with a first network and to wirelessly transmitdata to the robot. The wireless communication system also includes aserver configured to communicate with the network interface unit via thefirst network. The robot is configured to wirelessly transmit data tothe network interface unit, which is configured to convert the data froma wireless protocol to a network protocol used by the first network. Thenetwork interface unit transmits the data to the server. The server maybe configured to produce robot usage, robot behavior, and/or customer inbased on the data transmitted to the server. Also, a user terminalconfigured to communicably interface with the first network and tocontrol at least one function of the robot may be provided. The userterminal transmits a command corresponding to at least one robotfunction to the network interface unit via the first network. Thenetwork interface unit wirelessly transmits the command to the robot.User interaction is performed through this user interface, allowingfurther usage data to be collected. This offloaded interface also allowsthe robots to coordinate actions without needing to communicate directlywith one another. The robot systems are functionally independent of oneanother, but are tied together via the server through a single userinterface/data logging/usage information collecting server.

In one example, the wireless communication system includes audible,content stored at the server. The server is configured to transmit theaudible content to the network interface unit, which is configured towirelessly transmit the audible content to the robot. Alternatively,audible content may be stored at the user terminal, which is configuredto transmit the audible content to the network interface unit via thefirst network. The network interface unit is configured to wirelesstransmit the audible content to the robot. Furthermore, content may be,stored at a base station to which the robot docks for recharging and/orservicing.

Robot-generated data may include theme data corresponding to audiblecontent, in which the server transmits the audible content to the robotvia the network interface unit in response to the theme data. The datamay alternatively include a behavior theme configured to cause the robotto behave according to a theme. The audible content may include voicedata. Other robot behavioral changes may be implemented based onlong-term monitoring and analysis of the robot-generated data. (Forexample, if the robot does not make it back to the dock before thebattery gives out three times in a row, the server modifies the behaviorof the robot to start looking for the dock/base station earlier. Thismodifies the robot behavior to be “more conservative.”)

Behaviors are parameterized and can be modified, or evendisabled/activated based on analysis of usage/sensor information. Robotperformance can be autonomously modified by the learned effects of theactual customer home. This can take place after the robot has beenpurchased and server is updated to provide a better model of robot/borneperformance characteristics. The wireless reporting infrastructureallows a modification of behavior based telemetry to provide the bestperformance for a particular customer. The learning process is dynamicand can change as an understanding of the data increases.

In one implementation, the wireless communication system includes asecond user terminal which is configured to communicably interface withthe first network. A theme may be stored at the first user terminal,which transmits the theme to the second user terminal via the firstnetwork. The first network may include UDP, TCP/IP, and/or Ethernet, asexamples.

In another aspect, a content distribution system for distributing datato a robot includes a first server configured to communicably interfacewith a first network and a user-side node configured to transmit data tothe robot. The robot receives customizable content via the user-sidenode. In one example, the content distribution system further includes anetwork huh configured to use a protocol compatible with the firstnetwork and a network adapter configured to communicably connect thenetwork hub with the first network. The user-side node is configured todetachably interface with the network hub. In another example, a dataslot is installed on the robot and configured to receive the user-sidenode. In yet another example, the content distribution system furtherincludes a content server configured to communicably interface with thefirst network and to transmit the audible content to the robot via theuser-side node using the first network. The content server transmitscontent to the user-side node based on information received from thefirst server (e.g., the content served by the content server may includelicensed content such as music or sound, images, “dance” moves orpatterns performable by an appropriate type of mobile robot such as awheeled robot—also referred to herein as “robo-motions”, and the like,for which the copyright is held, by a third party; alternatively, thecopyright holder of the cement may be the manufacturer or any otherentity). Also, the user-side node of the content distribution system maybe configured to receive content from the server via the first network,and the user-side node may be configured to transmit the content to therobot via a wireless communication protocol.

In some instances, the content distribution system further includes auser terminal configured to communicate via the first network and acontent selection display presented on the user terminal. Thecustomizable content is transmitted, to the robot when selected from thecontent selection display on the user terminal. The user-side nodeincludes an Ethernet dongle or a USB dongle (or “network bridge”)configured to detachably connect to an Ethernet hub. The user-side nodeis configured to receive content via the Ethernet hub and is configuredto transmit the content to the robot via a second protocol differentfrom the first network. (As used herein, the term “data bridge” isunderstood to refer to all such dongles and/or pocketable and/orportable devices capable of appropriately communicating with a robot,either via wireless, wired, or direct physical connection, or any othersuitable modality for such a portable device to communicate and/ortransmit data to the robot.) Also, the user-side node may receivecontent from the data bridge or from a remote site, with no clientapplication located on the user terminal, just a web browser.Alternatively, a specific client application may be provided. Theuser-side node may be configured to operate using power supplied via thefirst network. The customizable content may include audible content,which may be organized into a theme of related discrete sounds.

In other instances, the robot transmits information corresponding to atheme to the server via the user-side node and receives customizablecontent including thematically related audio data corresponding to thetheme. In one implementation, a main body of the robot includes adetachable body panel having an audio/theme identification unit. Therobot is configured to identify audio content and/or a themecorresponding to the detachable body panel via the theme identificationunit. The second protocol may include a wireless transmission protocol(e.g. ZigBee, 802.11a/b, wireless USB, serial-over-RF, AMPS, CDMA, GSM,Bluetooth, a simplistic or proprietary scheme, etc.).

The content distribution system may further include a voice synthesizerinstalled to the robot, in which the audio data includes voice synthesisparameters (for altering the perceived “personality” of a robot, or tobetter accommodate someone who has hearing loss in certain frequencyranges, for example).

Also, the robot may further comprise a robot firmware which iscustomized based on user feedback or robot, sensor data processed by aserver, in which the robot firmware is downloaded to the robot from theserver.

The details of one or more implementations are set forth in theaccompanying drawings and the description below. Other features,objects, and advantages will be apparent from the description anddrawings, and from the claims.

DESCRIPTION OF DRAWINGS

FIG. 1A is schematic diagram showing an example of a power-saving robotsystem.

FIG. 1B is a sectional view showing an example of a mobile robot.

FIG. 1C is schematic diagram showing an example of a peripheral device.

FIG. 2 is a schematic diagram showing an example of a robot system.

FIG. 3 is a block diagram showing an example of a network data bridge.

FIG. 4 is a schematic diagram showing an example of a robot systemincluding mobile robots, in which a computer transmits themes to themobile robots.

FIG. 5 is a schematic diagram showing an example of body panel themesfor mobile robot.

FIG. 6A is a schematic diagram showing an example of a mobile robot thatincludes a network data bridge.

FIG. 6B is a schematic diagram showing an example of a mobile robot andan example of a network data bridge which connects to other networks viaa network that rims over power lines in a building.

FIG. 7 is a block diagram showing an example of a robot system includinga manufacturer server and a licensed content provider server.

FIG. 8 is a schematic diagram showing an example of a robot systemincluding a vendor and a manufacturer server.

FIG. 9A is a state diagram showing an example of a state machine for amobile robot.

FIG. 9B is a state diagram showing an example of a state machine for amobile robot.

FIG. 9C is a state diagram showing an example of a state machine for amobile robot.

Like reference symbols in the various drawings indicate like elements.

DETAILED DESCRIPTION

FIG. 1A is schematic diagram showing an example of a power-saving robotsystem 100. The system 100 includes a peripheral device 102 and a mobilerobot 104. In this example, the mobile robot 104 is a cleaning robot,such as a vacuum, brushing, or mopping robot. The peripheral device 102transmits wireless commands to control the movement of the mobile robot104. When the mobile robot 104 is out of range of the peripheral device102, the peripheral device 102 enters a hibernation mode or low powerconsumption state. When the mobile robot 104 is in range of theperipheral device 104, a wireless command transmitted by the mobilerobot 104 activates the peripheral device 102 from the hibernation mode.In certain implementations, the mobile robot 104 and the peripheraldevice 102 use a point to point protocol while communicating to oneanother. In certain implementations, the peripheral device 102 is a basestation, such as a device to recharge the mobile robot 104 or areceptacle to empty debris from the mobile robot 104.

Referring to FIG. 1B, the mobile robot 104 includes a drive system 1042,a wireless communication component 1044, and a controller 1046. Thedrive system 1042 moves the mobile robot 104 about an environment, suchas a floor to be cleaned. The wireless communication component 1044communicates with the peripheral device 102. For example, the wirelesscommunication component 1044 may receive signal beams from theperipheral device 102, such as infrared (IR), radio frequency (RF),and/or audio signals. In certain implementations, RF signals may be usedto provide communication when the peripheral device 102 and the mobilerobot 104 are outside of one another's line of sight. In certainimplementations IR signals may be used to provide communication when theperipheral device 102 and the mobile robot 104 are inside of oneanother's line of sight. In addition, the mobile robot 104 may use thesignal strength to determine a distance to the peripheral device 102.The signals may prohibit movement of the mobile robot 104 through, aparticular area or guide the movement of the mobile robot 104 to aparticular area. In addition, the controller 1046 uses the wirelesscommunication component 1044 to temporarily activate the peripheraldevice 102 from a hibernation state, such as a state consuming a lowamount of power. In certain implementations, the mobile robot 104 usesan IR signal, or line of sight form of communication, to activate theperipheral device 102 from the hibernation mode, in certainimplementations, the mobile robot 104 sends the activation command inresponse to a query from the peripheral device 102. In certainimplementations, the mobile robot 104 occasionally sends the activationcommand, such as continuously or periodically.

Referring to FIG. 1C, the peripheral device 102 includes a power supply1022, a wireless communication component 1024, and a controller 1026.The power supply 1022 may be, for example, an electric battery. Thepower supply 1022 provides power to the various functions of theperipheral device 102, such as generating navigational signal beams 106a-c. The wireless communication component 1024 generates a fence beam106 a, a left guide (or directed) beam 106 b, and a right guide (ordirected) beam 106 c. The wireless communication component 1024 alsoreceives wireless signals from the mobile robot 104. The controller 1026activates one or more of the beams 106 a-c during the active mode anddisables beams 106 a-c in the hibernation mode. In certainimplementations, the peripheral device 102 occasionally listens for asactivation command from the mobile robot 104. In certainimplementations, the peripheral device 102 sends an activation poll tothe mobile robot 104 to determine if it should become active, in thisexample, the fence or barrier beam 106 a prevents the mobile robot 104from passing through the area where the mobile robot 104 detects thefence beam 106 a. Beams 106 b-c aid the navigation of the mobile robot104.

In certain implementations, the robot 104 includes a display panel 105in electrical communication with the controller board 1046. The displaypanel 105 includes indicia 1052 and an audio output device 1054. In oneexample, the indicia 1052 include a segmented illuminable maintenancedisplay substantially mimicking the appearance of the robot. In otherexamples, the indicia 1052 include themed displays, which will bedescribed later in further detail. The controller board 1046 controlsthe illumination of indicia 1052 and the audio responses front the audiooutput device 1054.

The peripheral device 104 may perform in several capacities. Forexample, the peripheral device 102 may act as a fence. The peripheraldevice 102 may use the fence beam 106 a to prevent the mobile robot 104form passing through an area, such as a doorway. The peripheral device102 may also act as a gate. The fence beam 106 a may provide a gatethat, prevents passage during a particular time interval, such as whenthe mobile robot 104 is in the process of cleaning a room. Theperipheral device 102 may deactivates the fence beam 106 a when themobile robot 104 has finished cleaning the room and grants passage tothe mobile robot 104. The mobile robot 104 uses the beams 106 b-c toguide its way through the area covered by the gate. In addition, theperipheral device 102 may act as a trail marker or navigation beacon.For example, as described above the mobile robot 104 may use the beams106 b-c to navigate through areas, such as doorways. The beams 106 a-cmay contain information, such as an identifier (ID) of the peripheraldevice 102, an identifier of the type of beam, and an indication ofwhether the peripheral device 102 is a gate or a fence. If is a gate,the beam identification allows the robot 104 to determine whether it isdetecting the left or right guide beams 106 b and 106 c, respectively.The peripheral device identifier allows the mobile robot 104 todistinguish the beams 106 a-c of the peripheral device 102 from beamstransmitted by another peripheral device. The mobile robot 104 may betaught (or may itself learn) a path to an area, such as a back room of ahouse, by following a pattern of peripheral device identifiers. The beamtype identifier indicates whether the beam is a fence beam 106 a, a leftside navigation beam 106 b, or a right side navigation beam 106 c. Ifthe beam is a fence beam 106 a, the beam information may also indicatewhether the beam is acting as a gate that may be opened, given theproper command, or a barrier that remains closed. In any case, while themobile robot 104 is out of range, the peripheral device 102 hibernatesand the beams 106 a-c remain inactive.

The wireless communication component 1024 of the peripheral device 102receives a signal from the wireless communication component 1044 of themobile robot 104 to activate the peripheral device 102 from ahibernation state. In certain implementations, the mobile robot 104transmits a first activation signal 108 a to activate a first set ofperipheral device beams, such as the fence beam 106 while cleaning is inprogress. In certain implementations, the mobile robot 104 transmits asecond activation signal 108 b to activate a second set of peripheraldevice beams, such as the navigation beams 106 b-c when the mobile robot104 moves to another room. In certain implementations, the signals 108a-b include a mobile robot identifier. The peripheral device 102 may usethe mobile robot identifier to activate, for example, a first set ofbeams, such as the fence beam 106 a, in, response to an activationrequest from the motile robot 104 and a second set of beams, such as thebeams 106 b-c in response to an activation request from a second mobilerobot. In this example, the mobile robot identifiers allow theperipheral device 102 to activate beams based on the mobile robotrequesting the activation, such as by providing a fence to the mobilerobot 104 and a gate to a second mobile robot.

FIG. 2 is a schematic diagram showing an example of a robot system 200.The robot system 200 includes the mobile robot 104 and a network databridge 202. In this example, the wireless communication component 1044of the mobile robot 104 receives serial, commands from the network databridge 202, such as radio-frequency (RF) signals. Typically, thesesignals may be transmitted by the network data, bridge 202 or other suchuser-side node, which is in turn connected to an Ethernetrouter/switch/hub 204 along with several other Ethernet-connecteddevices such as a home computer 206, a laptop computer 208, acable/DSL/satellite/broadband-adapter 210 or modern, and e.g. one ormore other computing devices such as a personal digital assistant 212.

In one example, the network data bridge 202 which attaches to anEthernet port on the Internet-connected router 204 or switch mayautomatically download a script from a predetermined Internet, or localserver (e.g., via BOOTP, DHCP, HTTP, FTE, and/or TFTP) thereby providingautomatic commands, such as device configuration or diagnostic testing,to be performed. Alternatively or additionally, a user may manage themobile robot 104 using a device, such as the computer 206. TheEthernet-attached network data bridge 202 may provide for configurationand operational functionality via a small, embedded HTTP server builtinto the firmware of the network data bridge 202. Devices other than thecomputer 206 may also be used to interface with the network data bridge202, such as a set-top box, a game console, the PDA 212, a cell phone214, or a home server that is programmed to communicate using web orother networked interfaces.

As an alternative, access to broadband is provided via a USB port, asmay be provided by the computer 206. For example, a user may insert adriver CD-ROM into the computer 206 upon plugging in a USB-basedwireless transceiver, in order to install a driver therefore. Anotherconnection, such as IEEE 1394/Firewire, RS-232, parallel portconnections, and/or X10, may be used. These, however, may notnecessarily be network data bridges.

Once a network data bridge 202 is attached to the network-accessibledevice 204, it can contact a server.

FIG. 7 is a block diagram showing an example of a robot system 700including a manufacturer server 702 and a licensed content providerserver 704. The manufacturer server 702 and the content provider server704 may be connected to the broadband modem 210 via the Internet 706 oranother appropriate network. The mobile robot 104 may report informationto the server 702, such as the status of the mobile robot 104 or usagedata regarding the mobile robot 104. The server 702 may store thereported data in a repository 708. The reported data may be associatedwith information regarding the user of the mobile robot 104. The userinformation may be stored in a repository 710.

Further, the network data bridge 202 may connect wirelessly to themobile robot 104 and initiate communications therewith. While theEthernet hub 204 includes four wired Ethernet ports as well as 802.11wireless Ethernet connectivity, and although 802.11 or other suchwireless networking protocol may be used to communicate with a mobilerobot 104 from the base, station other than via a network data bridge,in certain implementations, the mobile robot 104 and the network databridge 202 use a simple, serialized RF protocol in order to exchangeinformation between the mobile robot 104 and the base station, ratherthan the full-weight networking protocols.

In certain implementations, the mobile robot 104 may be furthersimplified by providing receive-only functionality on the mobile robot104, instead of bi-directional wireless communication support. However,as an alternative, the mobile robot 104 may include full bi-directionalwireless communications support in order to transmit information fromthe mobile robot 104 to the base station (and e.g., to the user, themanufacturer, etc.).

The manufacturer may receive real-world mobile robot data for productrefinement and R & D. For example, the mobile robot 104 may collect dataregarding behavioral patterns (e.g., a number of errors encountered, anumber of times the mobile robot 104 has become stuck, or how frequentlythe mobile robot 104 is used) and forward such information to the mobilerobot's manufacturer for refining market research and producing futuremodels of the mobile robot 104, for example, by correcting design flawsor device problems. Moreover, customer information such as frequency ofrobot use, name, customer ID, etc., may also be correlated usinginformation forwarded to the manufacturer's website from the mobilerobot 104 via wireless and wired networking.

In addition, instead of the user having to locate and tote the mobile,robot 104 to the base station in order to physically connect the mobilerobot 104 thereto for software upgrades, software updates, and the like,a wireless update function may be provided by the network data bridge202 in order to update the robot's firmware or other on-board software,personality, sounds, and/or displayed pictures. Also, a user may designthemes or other content and have this content transmitted to the mobilerobot 104 via the wireless communication channel provided by the networkdata bridge 202.

FIG. 3 is a block diagram showing an example of a network data bridge.The network data bridge 202 includes a network connector 302, such as anRJ-11-style male. Ethernet connector. Also, the network data bridge 202includes an antenna 304, such as an enclosed, internal antenna,operatively driven by a wireless command interface 306, which is in turnconnected to a data bridge component 308 (the mobile 104 robot maylikewise include art enclosed, internal antenna; alternatively, eitherthe network data bridge 202 and or the mobile robot 104 may either oneor both include one or more external antennas, either in addition to orin lieu of an internal antenna, for example). The data bridge component308 is connected to a broadband network interface 310 for managing andconverting inbound and outbound broadband-side data (such as Ethernet,802.11b, and/or TCP/IP packets) to and from to a wireless-sidesimplified networking protocol. The data bridge component 308 extractsserial commands received by the broadband network interface 310 andbroadcasts the commands via the wireless command interface 306 and theantenna 304, using the RPAN protocol.

The network data bridge 202 is plugged directly into the owner'sbroadband router 204. The network data bridge 202 acquires networkinformation from a DHCP server or optionally configured by an advanceduser. The network data bridge 202 calls home (i.e., a home robotmanufacturer's or reseller's Internet server) with local configurationinformation (serial number, local network properties, etc.). The networkdata bridge 202 begins polling a pre-configured URL with periodic HTTPPOSTs. Each post contains status information on the mobile robot(s) 104in the customer's home. This data can be robot/firmware specific—thenetwork data bridge 202 need not understand the data itself (although itmay well do so in certain implementations).

A CGI script receiving the POSTS processes this sensor report andupdates an internal database creating a historical view of the robotsystem. Software-based virtual sensors examine this database (on aper-robot basis) and trigger events such as virtually pressing a buttonon the robot or triggering an email to its owner.

The owner may visit the home robot manufacturer's web presence using amodern, i.e.; JavaScript-enabled (or any other suitable scriptinglanguage such as Visual Basic, python, PERL, Php, etc.) web browser, andcreates a user account. As part of the registration, process, thecustomer enters the unique key as shipped with the wireless databridge—this unique key pairs the incoming sensor stream with this user'saccount.

After registration, the user may be forwarded to their portal page. Thispage is dynamically generated using the information already provided bythe robot gateway and product information and tie-ins provided by theback end infrastructure of the manufacturer's server(s).

Owner browses to theme or content store and purchases an audio themewith immediate online delivery. Theme or content store contacts robotsensor database and adds to the command queue: “download this content torobot #2” When the gateway device next posts sensor data, the HTTPresponse is the command to download the attached content data to thespecified robot. The wireless data bridge begins forwarding this binarystream to the robot via RF. When completed, the gateway may sends adownload acknowledgement with the next sensor report.

During this transaction, the javascript (or other suitable script)embedded into the owners' web interface has been polling the back-endservers for status, updates. A progress bar has been drawn and animatedusing javascript and DHTML (or Ruby on Rails, a JAVA applet, or anyother suitable display technology). The user may feel that s/he isinteracting directly with the robot via the web page, despite the levelsof software and communication indirection laying therebetween.

In one implementation, the wireless data bridge 202 may include a femaleport into which an Ethernet patch cable (or other such networking cord)plugs into from a suitable network connection point, and/or into whichan interface portion of a home robot attaches, for example. As examplesof such a system as described hereinabove, these communication channelsprovides a mechanism for retrieving sensor data and sending commands torobots in the field by piggy-backing on their broadband connection.

Such a bi-directional communication system allows deployment of onlineservices and to retrieve sensor data from a manufacturer's installedbase for improved customer service and system characterizations. It mayfurther increase the manufacturer's comprehension of how robots andindividual subsystems, perform in the field.

Interaction the network-enabled mobile robot(s) 104 in a customer's homemay take place through a web browser, in accordance with certainembodiments. Web browser access provides support for robot interactionvia non-PC devices (e.g., cell phones, and PDAs) with compliantbrowsers.

FIG. 6A is a schematic diagram showing an example of the mobile robot104 that includes the network data bridge 202. In this example, thenetwork data bridge 202 is a card that is inserted into an interfaceslot 602 in the mobile robot 104. This type of network data bridge maybe self-contained and transport data on constituent RAM, ROM, Flash, orEEPROM, type storage devices (which might be loaded with software,video, or audio content either at a user's computer equipped with aspecial writing unit or at the manufacturer in order to provide contentsuch as themed content, for example); or can be loaded with codenumber(s) that authorizes a wireless download to the network data bridge202; or, alternatively, may be connected to a network via a wire or bywireless Ethernet, for example.

A “Memory stick”-type (serial port interface), network data bridge 202may provide content to mobile robot users who lack an Ethernet hub orInternet connection, or for users who are unable to purchase contentonline via credit card, or who simply come across a set of content whileat a store and wish to make an impulse purchase or gift purchase foranother. Furthermore, similar to the network data bridge implementationdiscussed above, personal computer use is not necessarily requiredbecause the user may plug the “memory stick”-type network data bridge202 directly into a receptacle 602 defined by the mobile robot 104, andcontent on the network data bridge 202 may be automatically uploaded tothe mobile robot 104. See, e.g., U.S. patent application Ser. No.11/166,518, incorporated herein by reference in its entirety.

FIG. 6B is a schematic diagram showing an example of the mobile robot104 and an example of the network data bridge 202 which connects toother networks via a network that runs over power lines in a building.The network data bridge 202 may be configured to plug into a standardpower outlet 604 and to participate with a home power-line network, forexample, in homes or markets where Ethernet networking components arenot available. Alternatively, the network data bridge 202 may plug intoa standard telephone wall jack in order to communicate via a hometelephone wiring network, for example. In certain implementations, thenetwork data bridge 202 might be plugged into any of an Ethernet port,the power socket 604 or a telephone wall jack, and auto-negotiate aconnection to the Internet (if available) and/or to the mobile robot(s)104. To this end, many “Ethernet-over-home power lines” and similarschemes or products are widely produced and well known in the art; forexample, as an early commercial endeavor in this technology area, theX10 communication standard permits communication over power lines byencoding a single bit of information at each zero point in the 120V(RMS)@60 Hz power cycle common in North America, for example, and manymore modern Ethernet-like power line networking systems are commerciallyavailable, in which each networked device connects to the networktypically via an electrical socket on a wall. A common feature is thatthe network data bridge extracts the serial commands and data fromencapsulating broadband protocols (Ethernet, TCP/IP, 802.11x) fortransmission on the local wireless robot network (RPAN), and similarlyencapsulates such commands and data from the RPAN for transmission onthe broadband network.

The wireless data bridge 202 may provide web server functionality andserve static or dynamic web content corresponding to enabled mobilerobots 104 belonging to the mobile robot user. Such web serverfunctionality may be provided on the mobile robot user's local broadbandnetwork and e.g., be broadcast discoverable using TCP/IP, UDP, Ethernet,SNMP, NetBEUI, IPX, SMB or uPnP broadcast network announcing, forexample, in order to be found by mobile robot users when browsing thelocal area network; alternatively, a static network address (such as astandard, pre-set IP address) may be assigned to the data bridge 202such that users may simply type the static network address into a webbrowser to reach the web server on the network data bridge 202. The webcontent may be active or static, and may be tailored to thefunctionality to be provided and/or may be updated via the Internet orlocal network.

FIG. 9 is a schematic diagram showing an example of the robot system 200with a content serving system for transmitting content to a mobilerobot. The system 200 for accessing home robot-related content andcontrolling a home robot via the Internet may include an embeddedweb-server; an online presence accessible as a service/content provider;and a web-based user interface specific to the robots 104 in thecustomer's home. These components may be used to tunnel events acrossthe Internet to an online “robot presence” generated by, for example, ahome robot manufacturer. This “robot presence” may provide interactivitywith the user's home robot (audible content or other types of themeand/or content downloads, remote button presses, etc.) via a hosted webservice. The events thus tunneled may include: changes in sensor values,user interaction, commands to the robot, and state changes, inter alia.Use of a bi-directional communication channel (such as a wireless robotnetwork communication channel) allows melding between a robot insomeone's home, procedural and informational repositories on a remoteserver, and a web-based robot user interface, to produce powerfulcapabilities and forge new functionalities such as adding offloaded“intelligence” to otherwise simple robots (by, for example, performingthe bulk of number-crunching or compute-intensive tasks on a separatecomputer. Or server, and simply uploading and/or downloading resultsand/or sensor input to and from the home robot itself). In effect, bytunneling the local robot system's communication fabric across theInternet or other suitable network, it is possible to allow back-endservers to interact with robots in users' homes.

The data bridge 202 may send local network information to the Internetserver. As a non-limiting example, the user may connect to the Internet706 and may be redirected to the local bridge as appropriate. Bypublishing a well known Internet address that both bridge and/or theuser may access, the need to know the user's local information may beeliminated.

In addition to the network data bridge 202, a wireless remote controlmay offer several similar wireless functions for controlling or managingthe mobile robot 104. The wireless remote control may communicatedirectly with the mobile robot 104 via an infrared (IR) or RF protocol,or may relay commands through the network data bridge 202, for example,when the mobile robot 104 is not within sight but the remote control iswithin IR signaling, range of the network data bridge 202. The networkdata bridge 202 may thus also be provided with an FR sensor forreceiving mobile robot control commands from the wireless remotecontrol, and then relay the commands wirelessly to the mobile robot104—for example, the embedded web-server may bridge a proprietary orad-hoc communication method used internally by the mobile robot 104 (andalso used by accessory items added to the mobile robot 104) with apersistent online presence by translating the internal communicationprotocol(s) into HTTP POST and GET transactions.

The online presence may generate a web-based user interface thatincorporates javascript components to asynchronously poll the mobilerobot 104 for state changes (e.g., battery voltage). This javascript mayasynchronously fetch changes in the robot properties and rewrite thecontent in the page. Sensor values, etc., can be refreshed by the webbrowser without the customer needing to click refresh on the browser,for example.

The web-based interface may use customer tracking and persistence robotsensor data to, pair the mobile robot 104 with the customer account andpresent user interfaces for equipment the customer owns.

Further, if a series of the peripheral devices 102 are arrangedthroughout a home or other location and set up as a relay networkstemming from the base station, for example, then the commands relayedfrom the remote control may also be relayed throughout the beaconnetwork to reach a home robot that may be quite distant from the remotecontrol.

Wireless bandwidth (especially in unlicensed bands such as 900 MHz, 2.5GHz, or any other such suitable public RF band) is by its naturelimited, and because the presence of multiple RF devices (such as, forexample, multiple mobile robots and/or network data bridges; Wifi,BlueTooth, X10, mobile or portable telephone or other common wirelessdevices; and/or interference from sources such as solar flares. RFdischarge from electrical lines, florescent lights, or any otherRF-interfering entity) may further restrict the effective amount ofbandwidth or the degree of reliability of bandwidth available forwireless mobile robot communications, reliability and postponementmeasures may be taken to enhance the functionality of the network databridge 202 and/or the mobile robot 104; conversely, the network databridge 202 and/or the mobile robot 104 may be configured to reduce theirconsumption of available bandwidth in order to give priority to otherwireless devices. For example, regarding the reliability of the wirelessrobot network communications, techniques such as cyclic redundancychecking (CRC) and/or hash routines (such as, MD5 sums or CRAM) or otherappropriate reliability techniques (such as parity or error correctingcodes (ECC)) may be employed on either the data bridge-to-robot channeland/or the Internet-connected channel (e.g., the Ethernet-to-data bridgechannel). Furthermore, to limit the use of valuable bandwidth duringbusiness or other peak usage times, the network data bridge 202 and/orthe mobile robot 104 may be scheduled to transmit theme content,usage/behavior data, or any other such communication during night-timeor off-peak times; alternatively, for example, the network data bridge202 and/or the mobile robot 104 (and/or the manufacturer's server) maybe scheduled to perform their communication (or the bulk of theircommunication) at an automatically detected off-peak usage time, bydetecting when bandwidth usage is lowest (either in real-time or bycollecting data of bandwidth usage-per-time-of-day over a series of daysor weeks and then determining the generally least used times of day, asnon-limiting examples). Reliability measures may be taken at either thenetwork or application layer or both, for example, or at any othersuitable layer in a communication stack (such as the data bridge usingUDP on the Internet for simplicity and non-critical communications, butthe web server using full error-checking, reliability and/or errorcorrection measures, windowing, etc.

Also, the web server functionality in such a data bridge can communicatewith a known network address or location (such as a fixed IP address oruniform resource locator (URL)) in view of issues that arise with DHCPand dynamic IP address assignment, for example; the web server on thenetwork data bridge 202 may thus behave in a manner similar to a clientfor a significant portion of time in order to actively access and/orpoll “server”-like resources available on the mobile robot 104 (viawireless connection, for example), as in many examples the mobile robot104 maintains relatively little network functionality in the mobilerobot 104 itself (such capabilities being offloaded largely onto thenetwork data bridge 202).

The web server functionality may establish network communications withthe mobile robot 104 and/or Internet server(s) via a suitable protocolor standard, such as FTP, FTPS, TFTP, HTTP, HTTPS, GOPHER, TELNET, DICT,FILE and LDAP, HTTP POST, HTTP PUT, FTP uploading, HTTP form basedupload, proxies, cookies, user+password authentication (Basic, Digest,NTLM, Negotiate, Kerberos4), file transfer resume, http proxy tunneling,and/or other suitable network methods (such as a method supported bylibcurl, for example). The network data bridge 202 may employ networkannouncement techniques such as uPnP, dynamic DNS, reverse ARP, Ethernetor UDP or TCP/IP broadcasting, or another suitable method ofbroadcasting the existence of the network data bridge 202 to otherdevices on the same network.

By offloading much of the server functionality from the mobile robot 104to the network data bridge 202, and using the network data bridge 202 asa communications proxy, mirror and gateway, the mobile robot 104 is alsoshielded from excessive client requests that might, otherwise tax itsprocessing and/or bandwidth resources. For example, the mobile robot 104may in one time period (e.g., ten minutes) produce thirty visualsnapshots from an on-board camera. Then, if several entities were toattempt to download the snapshots from the mobile robot 104simultaneously, the mobile robot 104 might quickly be overwhelmed as thewireless network became bogged with service request traffic. As analternative, however, the mobile robot 104 may be accessed by just oneentity, the network data bridge 202, at a known regimen of pollingrequests, thus preserving the mobile robot's bandwidth and processingcapability while still permitting replication of any such collected databy copying it to Internet servers for broader access, for example.

In addition to RF-band wireless communication, the network data bridge202 (and/or the mobile robot 104 or the peripheral device 102) maytransmit via other suitable frequencies and/or bands in theelectromagnetic spectrum, such as the 900 MHz, 24 GHz, microwavefrequencies, or other suitable bands. To alleviate interference that mayoccur in these or the RF or another band, the mobile robot 104 and/orthe network data bridge 202 may employ frequency shifting, spreadspectrum, sub-channel technologies, and/or other suchinterference-avoidance schemes or techniques for avoiding interferencewith other unlicensed RF applications (phones, baby monitors, etc.).

In addition, robot commands might be sent by the network data bridge202. Additional functionality may be provided to the user in the form ofissuing remote commands while away from home. Accordingly, if a homerobot owner were to forget to schedule or activate the mobile robot 104prior to leaving on a business trip, the mobile robot user might stillprogram or activate the mobile robot 104 remotely via a commandgenerated by (for example) a mobile robot interaction website providedby the mobile robot manufacturer, which would be relayed through theInternet or other suitable network to the network data bridge 202, whichwould in turn convert the information received from the Internet into acorresponding wireless robot network command and transmit the commandwirelessly to the mobile robot 104 for execution.

In certain implementations, a series of robot commands corresponding totiming and execution of movements, etc., may be compiled into a “dance”routine and transmitted to the mobile robot 104 after a user selects the“dance” from a website maintained on the mobile robot manufacturer'sserver; alternatively, the “dance” might be combined with audiblecontent such as music or sounds, and/or commands to control the indicia(such as light-emitting; diodes (LEDs), liquid-crystal displays, and/orbacklights, inter alia) to provide a multimedia “dance,” music andlightshow. A further non-limiting example includes live trouble-shootingor technical support provided to mobile robot users, initiated through atelephone call or the Internet, or e.g., through a microphone andspeaker installed as part of the mobile robot 104 along with theappropriate computing, recording, mixing, and transceiving hardware andsoftware (and bandwidth, both wireless and over the Internet, as well asproper latency and synchronization). Additionally, for example, a cameramight be included for enhancing such virtual interaction, and/or theproximity sensor normally put to use in obstacle detection may beemployed during alternative modes as a general-purpose observationcamera in those implementations in which the proximity sensor isconfigured to function as a visual-spectrum camera, with encoding andtransmission of streaming video from the robot via the wireless link tothe network data bridge 202 and onto a networked destination, interalia.

Similarly, for transmitting robot usage and behavior information to themobile robot manufacturer's server, the mobile robot 104 may collectcertain, data regarding battery use, recharging frequency, amount oftime spent performing its primary task, the amount of time spent idle,the frequency with which the robot becomes stuck, etc., and periodicallytransmit this data to the mobile robot manufacturer's servers via thenetwork data bridge 202.

Moreover, the ability to transmit audible content to the mobile robot104, either via the network data bridge 202 or via a “memory stick”-typedata bridge, permits the mobile robot 104 to “speak” instructionsdirectly to the user of the mobile robot 104 at the time and place ofuse. For example, the mobile robot 104 may speak directions when in ademo mode that is initially run to demonstrate various features themobile robot 104 can perform. Voice instruction to the mobile robot usercan be accomplished by transmitting encoded audible content to themobile robot 104 (either by installing such audible content on read-onlymemory (ROM) in the home robot at the time of manufacture, or bytransmitting wirelessly or otherwise and storing the audible content inflash RAM, for example) and playing it back over an on-board decoderand/or synthesizer and speaker installed in the mobile robot 104.Synthesized speech encoded for decoding on speech synthesis hardware mayrequire less on-board storage than non-synthesized speech; however, asan alternative, natural or computer speech may be recorded as wave-formencoded (and/or psycho-acoustically encoded) sound data and transmittedto the mobile robot 104 for storage and later playback. Alternatively,however, speech for playback on the mobile robot 104 may also be encodedas WAV files or compressed sound files (e.g., employing compression suchas Lempel-Zev-Welch (LZW) or other techniques that are lesscomputer-resource-intensive than, for example, MP3 or Windows Media(WMV) decoding).

As another example, by using a synthesizer, a phoneme string file to bedownloaded to the mobile robot 104 may include and/or be thematicallyassociated with, for example, an animation storyboard file includingtags that trigger synchronized or asynchronous parallel movement events,lights (or other indicia) and/or non-synthesized sound Using such aphoneme pattern and storyboard, a string such as “he-llo ha-w [which mayhere represent a tag to start a “bowing” trajectory in, trajectory outmovement as an asynchronous ballistic behavior] a-re y-on” may thustrigger the associated “bowing” robo-motion (e.g., thematic “dance” oremotive behavior performable by the mobile robot 104). Further, if soundrecording hardware such as a microphone and sound processing hardwareare installed in the mobile robot 104, as well as sufficient processingor transmitting capability, then the mobile robot 104 may includespeech-recognition functionality in order to recognize spoken commandsor other interaction from mobile robot users; also, the storyboardingcapability as discussed above may encompass and encode responses, andreferences to any of the functionalities or capabilities performable bythe mobile robot 104.

An RF system used by the mobile robot 104, the network data bridge 202,the remote control, and/or the peripheral device 102 may include fourradio transceiver modules that are located in the mobile robot 104, theremote control, the peripheral device 102, and the network data bridge202. The remote control may use RF to transmit control signals to themobile robot 104 using a bidirectional protocol or unidirectionalprotocol; also, the remote control unit may allow the user to “drive”the mobile robot 104 around as well as sending scheduling data createdon the remote control unit. The mobile robot 104 may use RF to wake-upand power-manage the peripheral device 102 using a bidirectionalprotocol. The network data bridge 202 may use RF to transmit data andcode updates to the mobile robot 104 as well as to upload diagnosticdata from the mobile robot 104 using a bidirectional protocol.Furthermore, when there are multiple peripheral devices as well as thenetwork data bridge. 202 in operation, in which the peripheral devicesand the network data bridge 202 can maintain an RF or othercommunication channel in a relayed fashion, the wireless robot networkcommunication between the network data bridge 202 and the mobile robot104 may be propagated along the chain of peripheral devices even whenthe mobile robot 104 is beyond the direct RF range of the network databridge 202. The effective range of the wireless robot network can beextended by the linking of peripheral devices.

The 2.4 GHz ISM band may be used with either direct-sequence orfrequency-hopping spread-spectrum transmission techniques. In addition,either a custom proprietary protocol based on some implementation of astandard 7-layer OSI model may be used, or the ZigBee 802.15.4 standardprotocol may alternatively be used, inter alia. The custom protocol mayallow for proper regulatory compliance in all countries of interest, forexample, or alternatively, may be suited for each anticipated nationalmarket.

The following single chip, integrated RF transceiver radio modules areexamples of chipsets that may be used to implement the RF system:Chipcon CC2500; Chipcon CC2420; Freescale MC13191; Freescale MC13192. Aprinted circuit “F” style antenna design may be used with either noexternal RF power amplification or a suitable RF power amplificationdepending on the range and power requirements.

Regarding a proprietary robot-net RF protocol, such a protocol, may besimpler than Zigbee, for example, in that Zigbee has two parts—signaling(IEEE 802.154) and application (routing, etc.). As an alternative, theproprietary robot-net protocol may use 802.15.4 because the standard hasdriven down the cost of goods for antennas, microcontrollers, etc. Thecontemplated robot-net may however deviate from Zigbee (a is meshednetwork with routing) at least in that it may be a point-to-pointnetwork. Under Zigbee, nodes would be required (in some cases) to routetraffic for other nodes; this behavior may place excessiveresponsibility on Lighthouses, Remote controls, and RF data bridges,etc. Robot-net RF may include a sparse protocol that simply has robot orbeacon control and reporting messages like WAKEUP, GO_CLEAN(robot-n),ERROR(robot-n, i-am-stuck), etc.

The savings in complexity may enable small amounts of memory (e.g., 8K)on some elements of the network. As an example, a Lighthouse may have 8KByte of program memory. The port-to-point protocol may be simpler thanZigbee because it does not support routing of traffic from endpointsother than the home robot, products, encryption of data packets, or manyother features needed for meshing. Above this packet transport layer,robot-net may define messages that are specific to robot control andmonitoring, which are unique (lighthouses may also be configured to usethe protocol, although they may be turned on and off by the robotextra-protocol). This control is unique even, if implemented such thatZigBee forms a portion of the application layer, as a non-limitingexample.

At least one of the endpoints may be mobile. Instantaneous signalstrength, or signal strength over time can be used to help the robotnavigate or correct beacon-based navigation, e.g., by providingadditional data informing the robot that it is proceeding in the correctdirection or in a failure mode, as non-limiting examples.

With regard to a vocal and multimedia demonstration mode executed e.g.,just once when the mobile robot 104 is first used (and then theaccompanying data being e.g., discarded to liberate system resources),or at any time when an appropriate “demo” button is pushed, the demomode may include several speech files may be scripted in sequence; inwhich the script is not necessarily an interpreted script, but maysimply represent a linear routine coded in any suitable manner. Thescript may flash the lights and buttons visible on the mobile robot 104,make sounds and cause the mobile robot 104 to do the things it issupposed to demonstrate (such as spot cleaning). The demo script mayflash the lights or other indicia directly and run the behaviorsdirectly, or could generate phantom presses/sensor events within therobot's computer control system to make the appropriate indicia and/orbehaviors occur. For example, to start the spot cleaning demo, the voiceroutine could tell the user to press spot clean now or could send aphantom button press to the UI control, which would flash the button asusual and start as usual. Other demos may be triggered by fake signalsforwarded to a virtual sensor, for example—demo of stasis/stuck responseby telling the mobile robot 104 it is stuck, etc.), then wait a certainperiod before reasserting control for the remainder of the demo. Thedemo could detect that the user pressed the wrong button and redirecthim, as well, for example.

Examples of “robo-motions” (interchangeably, “animotions”) which may betransmitted either alone or as part of a theme or bundle may include newfunctional robot motions or behaviors such as spot-coverage,wall-following, and bounce operational modes, which may pertain to atleast certain implementations of mobile robots in accordance with thepresent invention are specifically described in U.S. Pat. No. 6,809,490,by Jones et al., entitled, Method and System for Multi-Mode Coverage foran Autonomous Robot, the entire disclosure of which is hereinincorporated by reference in its entirety.

In addition, according to one example, the mobile robot 104 may beprovided with a speaker for, playback of audible content, a wireless ordirect link to the network data bridge 202 for receiving the audiblecontent, and a processor (for example, a speech synthesizer, MIDIchipset and/or frequency modulation (FM) unit, etc) for replaying theaudible content. The audible content may have significantfunctionality—in a non-limiting example, a warning siren sound may bedownloaded to provide a clear signal when the mobile robot 104 detects apotentially hazardous condition such as overheating of a vacuum motor,or a series of slowly-spoken instructions may provide hard-of-hearing ordisabled mobile robot users with a more understandable tutorial on theuse of the mobile robot 104. Furthermore, the audible content and/ortheme may provide instructions or other speech in any of a variety ofhuman languages or dialects; in addition, any behavioral ormovement-based content such as may be associated with or included in aregional, national, linguistic, cultural, occupational, character orother such theme may also be appropriately correlated. For example, a“ballerina” theme might include spoken instructions affecting an accentreminiscent of a French accent, and a motion profile that causes themobile robot 104 to perform pirouettes, spirals, figure eights, andother movements reminiscent of a dancer performing ballet, inter alia,this might also be associated with a body cladding set that wouldsuggest a leotard, for example, to enhance the thematic effect.

The specific tying of certain content to certain behaviors is also madepossible. For example, whenever the mobile robot 104 performs a certain“roto-motion” or trick (or less sanguinely, gets stuck, for example)such as a game of chase, it might play the “William Tell Overture;”alternatively, it may issue plaintive wails for help when the mobilerobot 104 detects that it is lost, cut off from communication with anybeacon, the network data bridge 202 or a home base, or is otherwisestuck or stymied.

FIG. 5 is a schematic diagram showing an example of body panel themesfor the mobile robot 104. The mobile robot 104 may include customizable,snap-on or otherwise interchangeable exterior panels 502 a-b which maybe “themed” for permitting mobile robot users to individualize theirmobile robots. As an example, body panels may be molded from plastic andthereafter painted, dyed, or covered with an adhesive material; anysuitable modality for coloring, designing or drawing, patterns thereonmay be used, as appropriate. As an example, a design may be applied tothe interior of a transparent sheet-like polymer material, and then thepolymer sheet or body panel may be applied to a molded plastic piece asa body panel; as a result, the design is protected by the transparentpolymer sheet, while rapid diming of body panels in a “just-in-time”(JIT) distribution strategy may be achieved. The panels may also becustomized by user content, e.g., printed by inkjet onto an appropriatematerial. For example, the user may upload a photo, which can be adaptedto a template, and the JIT-made shell may be made and delivered at theappropriate time (e.g., x-mas panel with sounds of a user's own familysinging Christmas Carols, e.g. uploaded to the server by the userearlier for inclusion into a modified or customized theme).

Furthermore, the interchangeable body panels 502 a-b may include anidentification system corresponding to audible or other thematic contentthat may be transmitted to the home robot to complete the themingeffect. For example, the body panels include an electrical contact 504which is positioned along the interior edge of the panels 502 a-b so asto contact a corresponding electrical contact on the mobile robot 104when installed thereon. The electrical contact 504 on the body panels502 a-b is operatively connected to an appropriate electronicidentification unit, such as an integrated circuit (IC) 506 that outputsa voltage pattern corresponding to a unique theme ID number; and/or aspecific resistance 508 which likewise corresponds to particular themeIDs 510 a-b. Alternatively, the body panels 502 a-b may include an RFIDor passive magnetic device; a mechanical ID mechanism such as apunch-card like series of holes or peaks; an optical ID system such as abarcode or characteristic color; or any other modality suitable foridentifying a body panel's corresponding theme. The ID can betransmitted by the mobile robot 104 back to the network data bridge 202as authorization or identification to download, corresponding themedfirmware, multimedia, etc. to the mobile robot 104 as discussed herein.

As a default behavior, if no identification of the body panel can bemade by the sensors of the mobile robot 104, the mobile robot 104 maye.g., reject theme content as potentially unauthorized; or, conversely,accept any theme material if there is little concern regardingunlicensed theme content.

FIG. 8 is a schematic diagram showing an example of a robot system 800including a vendor 802 (as a type of audible or other content) and amanufacturer server 804. The system 800 acts as a content distributionsystem, in which the vendor 802 distributes licensed content to mobilerobots (“consumer robots”) under the supervision of licensing andsecurity-checking systems (“big brother” 806, “CRM” 808) as a back-endto a consumer-oriented website administered by a robot manufacturer(“E-Commerce Site” 810). In this example, “Rtoon” may signifydistributable content, whether audio or other thematic material, forexample.

Also, once an identification of the theme corresponding to an installedbody panel is determined, the mobile robot 104 may wirelessly transmitinformation regarding the detected theme ID to the mobile robotmanufacturer's server via the wireless robot network data bridge 202 andInternet, for example. The server may then determine whether audible orother content corresponding to the transmitted theme ID is available,and if so whether the corresponding content is properly paid for,licensed, etc. If all determinations are affirmative, the server maytransmit the corresponding content (such as a set of audio data arrangedas a sound theme and/or a set of robot “dance” commands, indiciapatterns, etc.) to the mobile robot 104 via the Internet and the networkdata bridge 202, fix example; alternatively, the server may transmit an“unlock code” or cryptographic key for decoding encrypted and/orotherwise restricted content already present at the mobile robot 104;or, for example, the mobile robot manufacturer's server may cause aseparate content server (e.g., belonging to a third party and underlicensing and electronic distribution agreement with the mobile robotmanufacturer, for example) to transmit such data to the appropriatemobile robot which sent the theme ID.

FIG. 4 is a schematic diagram showing an example of a robot system 400including, mobile robots 104 a-c, in which the computer 206 transmitsthemes to the mobile robots 104 a-c. Mobile robot users may receive newor updated musical, sound, visual, choreographic or other such thematiccontent which corresponds to the themed body panels installed on theirmobile robots. A website 402 displayed on the personal computer (PC) 206offers a choice of three sets of music contents, ‘A’ 404 a, ‘B’ 404 b,or ‘C’ 404 c, for transmittal to or activation on the mobile robots 104a-c).

Also, the theming may even extend to the content within themes—e.g., ifa robot has several audio files or “earcons” loaded (e.g., in a formatsuch as MIDI), and then selects a “steel drum” theme, the theme mightinclude musical instrument elements (e.g., also encoded as MIDIinstruments or other suitable format) which replace the standardinstruments that would normally be played in the earcons or sound flies;as such, a rock ballad may be “themed” into a Caribbean anthem, as anon-limiting example.

With regards to the themed content, combinations of variousinterdependent or independent) content types (e.g., including—but notnecessarily limited to—sounds, body cladding, choreographed “dance”moves, behavioral response profiles, or the like, as non-limitingexamples) are possible to permit a high degree of thoroughness in theimpact themes may have on users. Sounds such as background music to beplayed while the home robot either sits idle or performs tasks;“earcons”—that is, sounds that convey meaning and which are played backwhen triggered by certain events or behaviors, such as the robot playinga car-crash “earcon” when the robot bump sensor detects a collision withan obstacle, or the phrase “feed me!” as an earcon when the robot'sdetergent or other consumable bin is empty, inter alia; daily or monthlyactivity or activation schedules such that a “family dog” themed robotmay cease hibernation or recharging mode when a sound corresponding tothe delivery of the morning newspaper is detected, and then proceed tothe user's bedroom to “bark” and cavort about in figure “s” orsemi-random movement patterns (or to “wag its tail” by rotating the hindportion of the robot repeatedly back and forth) adjacent the user's bedto wake the user or to get the user's attention in a manner reminiscentof an excited dog; a “listening” behavioral routine which may cause therobot to, for example, behave as a parrot (e.g., in combination withother parrot-themed content such as plumage-like body cladding,“whistling” sounds and a parrot-like gait for movement) and repeat backrecently spoken words that are detected by an on-board microphone (e.g.,in a distorted, squawking manner reminiscent of a true parrot, forexample); and/or network-access patterns for robots equipped tocommunicate via a wireless network (for example, a “spy” theme might, incombination with various other thematic content, include a networkaccess profile that might cease all network access for various periodsof time when the “spy” robot is expected to maintain “complete radiosilence,” for example; or conversely may be conditioned to frequentlyretrieve updated information from a network source in order to fulfill arole as a trivia quizmaster by downloading questions and/or answers tobe posed to guests of the user while playing a party game, for exampleindeed, such quiz questions and answers or the rules of a game mightthemselves be bundled into a theme in static format, as a furtherexample of the broad extent of theme-able content types). Also, contentsuch as the “robo-motions” (“dance” moves or distinctive motionsperformed by wheeled or otherwise mobile home robots) may be triggeredon command by way of voice command recognition, etc., on the robot suchthat die user may clap her hands or verbally instruct the robot to “beg”or “stand still” or “dance the Lindy Hop,” and the robot would comply toby performing the associated robo-motion, for example.

Functional themes may enhance the primary purpose (or any other purpose)of the mobile robot, as well—for a non-limiting example, a “super robotcleaner” theme might include behavioral patterns that cause the homerobot to detect spots on the floor and to spend a particular proportionof cleaning time vacuuming or washing the spots discovered as a resultof the theme.

User commands to initiate actions such as power on/off, start, stop orto change a cleaning mode, set a cleaning duration, program cleaningparameters such as start time and duration, and or many other userinitiated commands, functions, and/or components contemplated for usewith the present invention are specifically described in U.S. patentapplication Ser. No. 11/166,891, by Dubrovsky et al., filed on Jun. 24,2005, entitled Remote Control Scheduler and Method for AutonomousRobotic Device, the entire disclosure of which is herein incorporated byreference it its entirety.

For another example of a type of theme which encompasses a variety ofbehavioral, audio, visual and other types of eclectic content, a mobilerobot may be themed as a chess piece, such theme to include not onlydistinctive body cladding (with different types possible such as“knight,” “rook,” “pawn,” etc.) and e.g., chess-themed music and sounds,but also e.g., a network behavior so as to coordinate with a centralserver (or possible to “swarm” with several other home robots alsoacting as chess pieces) so as to adopt the role of a particular piece ona chessboard, in which a user or users bring a plurality of home robotsand arrange them an environment simulating a chess board and command thehome robots to move as chess pieces during a chess game; this high-level“chess” theme thus may include also the rules of chess and behaviors andmovement patterns (as well as network routines and functions) of variouschess pieces, as well as visual and/or audio content and the like, forexample.

As illustrated by the above-discussed non-limiting examples, the contenttypes that may be used and combined, into theme packages may encompass abroad range of material, virtually as broad as the range of potentialcapabilities performable by the mobile robot 104, for example. Thepresent inventors intend that the examples of associated themed contentgiven herein can be generalized for the purposes of the inventionaccording to their readily recognized type:

The chess, and trivia game examples are examples of providing associatedthemed content linking at least two of a predetermined game rule set,game piece or paraphernalia set, game appearance, and game sounds.

The parrot and dog examples are examples of providing associated themedcontent linking at least two of a predetermined entity (i.e., animal orperson) motion set, appearance, and sounds. This would extend tocelebrities, so called “licensed properties” linked to well-knownentertainment programs or books, characters and the like.

The ballet example is an example of providing associated themed contentlinking at least two of a predetermined dance move set, paraphernalia,appearance, music, and sounds.

The country-and-western example below is an example of providingassociated themed content linking at least two of a musical genre moveset, paraphernalia, appearance, music, and sounds.

Mobile robot users with Internet-capable personal computers, cellphones, PDAs, and other devices may also browse the home robotmanufacturer's server via a web site and select themes, sounds, tones,“dances,” software, or other suitable mobile robot content for downloadand/or purchase. (For example, a user interested in quelling potentialsources of RF interference in her home, or for conserving bandwidth forother tasks, might purchase a low-RF-noise network profile content froma manufacturer's website, for example.) The user interface presented, tothe user may also be customized to apt match the robot theme aswell—that is, a theme may include multimedia content that can bemanifested on the robot but also on an online interface that isassociated with the robot having the theme, and with which the user itwhen using the online interface and/or the robot.

Also, users may select themed body panels, base stations, batteries,accessories, new home robots, data bridges, etc., from the web site, andhave the items shipped to their home. Items such as body panels may thenbe ordered in bulk in blank form by the manufacturer or reseller whooperates the web site, and then apply themed designs rapidly and“just-in-time” after (or before, when sales prediction analysis isproperly applied) receiving an order from a home robot user.

Furthermore, themed items may be accompanied by a CD-ROM, floppy disk,“memory stick”-type data bridge, or other data medium in order totransmit the appropriate corresponding themed content to the home robotupon installation of the ordered themed item. Alternatively, the mobilerobot manufacturer or reseller may omit shipping data media along withphysical items, and instead offer Internet-based transmission of thecorresponding themed content (via the wireless robot network databridge, for example), or do so when orders are received from customerswho the manufacturer or reseller has a record of having previouslybought the network data bridge 202, for example (or when records showthat the customer already has the most up-to-date version of theappropriate themed content). The mobile robot manufacturer or resellermay reduce shipping charges when it is known that the ordering customerhas the ability to update the mobile robot 104 via the network databridge 202, for example.

Moreover, by virtue of the online ordering system and manufacturer's orreseller's website, customers may be offered a variety of functional andthematic combinations for body paneling, sounds and music, “dance”routines, and indicia flash patterns (and/or one-off or single-itemofferings in a “mix-‘n’-match” mode, such as a Country/Westernpaneling-themed robot with a rock‘n’roll “dance” routine and a classicalpiano sound theme, in a non-limiting example). For example, theCounty/Western theme body panel 502 a is linked to music content ‘A’ 510a; and the piano theme body panel 502 b is linked to music content ‘B’510 b (which would usually be piano-related). Additionally, accessoryreplacement and service reminders tied to usage can becontemplated—e.g., reminders to replace the batteries after a certainnumber of recharge cycles or hours expended. The online service may beconfigured to enter a recommended replacement part (to replace a partrecorded as having accumulated sufficient cycles or time to be wornaccording to the uploaded data) or a consumable material such asdetergent, cat food, lubricant or any other such material (to augmentthe stock of the consumable material recorded as needing replenishment)into the user's online shopping cart or one-click purchase queue, asnon-limiting examples.

Other aspects of such a website may be handled in a conventional manner,by permitting online credit card or check payment, etc. As an advantage,customers may place orders for a customized home robot with their choiceof complete theme or a “mix-‘n’-match” robot (e.g., a male lion vs. afemale lion) personalized to the users' own eta variegated tastes andstyles. Moreover, by using laser printing or other modality for applyingdigital images and/or writing to the polymer sheet panel coveringsdiscussed above, users may be offered the option to apply slogans,names, or any arbitrary writing and/or images to be printed on theirhome robots, for example.

A fluffier example permits the user to create or record his or her ownsounds or music content and, to transmit this custom content to his orher home robot. In order to address licensing and unauthorizedduplication concerns, the home robot manufacturer may employ a mediaand/or authoring, software protection scheme, for example, such thatonly licensed copies of the authoring software will function properlyand such that only content produced on a properly licensed copy of themanufacturer-provided software will correctly play back on thatmanufacturer's home robots, for example. As a non-limiting example,public-key encryption techniques may be applied in which each robotreceives a public key known to the user (such as a serial number, forexample), and a private key known only by the manufacturer. Accordingly,when a home robot user purchases a copy of the content authoringsoftware from the manufacturer, the copy that the home robot userreceives may “watermark” its output content with the encryption key suchthat only the particular user's home robot can pay back the outputcontent, as a non-limiting example. Other encryption or protectionschemes may be employed to allow wider or narrow distribution, asappropriate to business and license/copyright protection concerns.

As a further example, users may be offered a content subscriptionservice in which a number of themes and/or audible or other content aremade available per month or other time period to the user who purchasesthe subscription. As an advantage, users cab be assured of the integrityof the content they download and copyright concerns can be addressed.

FIGS. 9A-C are state diagrams showing examples of state machines 900,930, and 960 for the mobile robot 104, the lighthouse peripheral device102, and a remote control peripheral device, respectively. The RobotPersonal Area Network (RPAN) protocol used by the network data bridge202, the mobile robot 104, and the peripheral device 102 can be used inmany ways as defined by applications.

FIG. 9A shows a high level state diagram that serves as a reference forthe following discussion. The mobile robot 104 is an RPAN masterresponsible for several tasks, such as providing a unique address toisolate communications with its, peripherals from other RPAN systems,deciding on a radio channel to use, operating on the common channel asnecessary to report this operational channel, and transmitting a beaconwhich defines time windows that peripherals should use to communicate.

When the mobile robot 104 is conserving power in its dormant state 902or charging, the RF network is inactive, meaning that no beacon istransmitted. While in this state 902, the mobile robot 104 can be wokenup over RF by executing the following steps in a constant loop.

-   -   1. Turn on radio on the Common Signaling Channel (CSC).    -   2. Send “Activate Invite” broadcast message.    -   3. Listen for “Activate Request” message for up to 30        milliseconds.    -   4. Receive “Activate Request” message and leave Dormant state.        Or, turn off radio and sleep for 970 milliseconds.

Therefore, every second the mobile robot 104 invites peripheral devices,such as the peripheral device 102, to wake it up. A peripheral wantingto wake up the mobile robot 104 will listen for a second for the“Activate Invite” message and respond promptly with the “ActivateRequest” message which wakes, up the mobile robot 104.

When the mobile robot 104 has been woken up to active scan state 904, itchecks if its radio channel is still valid. If the robot sleeps for morethan 10 minutes, the radio channel will be reselected. This time ischosen to safely exceed any session oriented timers. The first step inreselecting a channel is to actively scan for other RPAN masters andexclude their channels from the set of acceptable channels.

An active scan is performed by sending two “Ping” messages on the CSC tothe broadcast RPAN address. The mobile robot 104 listens for 30 ms aftereach message for “Ping Response”. Each “Ping” message is separated by360 ms.

After ruling out radio channels through active scanning the mobile robot104 moves to energy scan state 906, candidate channels are scanned forenergy levels in order of preference. On a given channel, 100 energylevel samples are obtained in about 100 ms of time. The first channel tohave an average energy level below an acceptance threshold is chosen asthe new operational channel. In the unlikely event that no channels meetthese criteria, one is randomly chosen.

When the mobile robot 104 is operating its RF network normally, then itis in normal state 908 and it transmits a beacon every 720 ms which iscalled the “beacon period”. In that beacon message, a window of timefollowing the beacon which is valid for devices to communicate isadvertised. This “contention access period” is set to 220 ms in thenormal mode. While not in the contention access period, the robotoperates on the common channel to answer “Ping” messages with “PingResponses” advertising the radio channel on which the robot isoperating.

The motivations behind the specific beacon and contention access periodschosen are as follows: to keep beacon tracking overhead low, to keepradio power consumption low, and to allow peripherals with veryinaccurate clocks, to reliably find robots. This final goal is satisfiedby defining one more time constant which is the “ping separationperiod”. If a peripheral sends two pings separated by 360 ms, the realtime assuming the clock is plus or minus 30% is anywhere between 252 msand 468 ms. On the low side, the 252 ms is sufficiently high so thatboth pings will not occur while the mobile robot 104 is on theoperational channel. On the high side, the 468 ms is smaller than the500 ms that the mobile robot 104 is listening on the common channelguaranteeing that one of them will be receiving during that time. Thereare other combinations of values that work. Also, with higher clockaccuracy the contention access period duty cycle can be higher. Thesevalues can be recalculated for other systems based on those needs.

The 500 ms when the mobile robot 104 is operating on the common channelrepresent a dead time that can be unacceptable at times. One such timeis when the mobile robot 104 is being driven remotely. Another is whenthe mobile robot 104 sensors are being monitored for diagnosticpurposes. When low latency state 910 is needed, a peripheral may send a“Low Latency Request” message which contains a byte representing thenumber of seconds that low latency mode should be used. The low latencytime can be refreshed with subsequent messages. Also, the mobile robot104 itself may switch to low latency mode.

FIG. 9B shows the state diagram 930 that serves as a reference for thefollowing discussion. In this section, message flows between the mobilerobot 104 and the lighthouse peripheral device 102 are illustrated. Aperipheral device, such as the lighthouse peripheral device 102, may bea simple slave device.

The slave 102 begins in a low power consumption state 932 designated as“Free” in the state diagram 930. In this state 932, it wakes upperiodically and attempts to join a robot network. It does this bysetting its channel to the common signaling channel (CSC is the 5thchannel). It then sends a broadcast message to ask any robots who arelistening on this channel to respond. The response from a robot hearingthis message advertises a network with an ID on an appropriate channel(zero based numbering). This is the same active scanning processdescribed above. The lighthouse 102 will get 0 or more responses in thetwo 30 ms windows of time it listens after sending the requests. If noneare received, it will go back to sleep and perform another active scanin 4 seconds. If one or more are received, it will choose to join thenetwork of a mobile robot whose response message was received with thegreatest signal strength value.

If the lighthouse 102 has ever received a Join Accept message from arobot, that robot's RPAN ID is used instead of the broadcast address inthe ping message. In this way, the lighthouse 102 will not waste powerwaking up for a robot that is in RF range but not its owner, e.g. theneighbor's mobile robot.

If the lighthouse 102 wants to join a robot's network and does not havean assigned address, the lighthouse 102 will randomly select a MACaddress (marked as “Soft” in the MAC header) to use temporarily untilthe robot assigns one to it.

In “Seeking” state 934, the lighthouse 102 changes channels and listensfor the beacon emitted periodically by the mobile robot 104. It shouldpick this up within a few seconds at most. If this does not happen, atimeout (30 seconds) will send it back to the “Free” state 932.

If all, goes well and the beacon is found, the lighthouse 102 willadvance to “Binding” state 936. In the “Binding” state 936 andsubsequent states, the lighthouse 102 will filter packets from otherrobots and monitor its link, to the RPAN network from the MAC layerbeacon tracking. These are shown in the state diagram as “Link Up” and“Link Down” events.

Upon entering this state 936, the robot will send a “join request”message. This starts a timer on the lighthouse 102 getting accepted intothe network within 5 minutes. If that expires, the lighthouse 102 willreturn to “Free” 932. (This 5 minute time period is known to both therobot 104 and the lighthouse 102 so that each can expire their pendingWhenever the robot 104 receives a join request that causes a collisionof soft MAC addresses in its table, it will send a join rejectionmessage that does not need to be acknowledged, and the entry will not gointo the table. The lighthouse 102 (and perhaps the other lighthousewith the colliding MAC address) will follow the Join Fail event on thestate diagram which will result in regenerating a MAC address and tryingthe bind again.

When the robot 104 receives a join request message and wants to delaythe binding until another handshake is performed as is the case withlighthouses, it sends a join pending message. A join pending, message isneeded if an acceptance or rejection will not be sent within 3500 ms.

While acceptance is pending, the lighthouse 102 will transmit a 4-bitcode in the confinement beam (11) which indicates that it has not boundto the robot. When the robot 104 runs into a code 11 beam, it stops andlooks at its list of lighthouses requesting bindings. For each entry, itissues a command to wink the code to 12. If that command is notacknowledged or the beam change is not seen, the lighthouse 102 is notin range, and the robot 104 moves on to the next entry in the list. Ifthe robot 104 succeeds in seeing, the beam, it sends a join acceptmessage which moves the lighthouse 102 into Active state 938 where itobeys beam commands requested by the master. The beam command messagecontains the state of beams as well as the 4-bit code that should be inthe beam.

While a lighthouse is in the binding state 936, it will probably losecontact with the robot 104 as it moves around a room and throughout ahouse. Losing, the beacon for over 2 minutes returns the lighthouse 102to the “Free” state 932 where the beams are off and power is beingsaved. When the robot 104 is back in range, the binding procedure isskipped since the assigned address is still valid.

After the lighthouse 102 has been bound to the robot 104, it willprobably lose contact with the robot 104 as it moves around a room andthroughout a house. A “Roam Recover” state is designed so that thebinding process does not have to be repeated following each of theseexpected losses of communication. A gross timeout of 90 minutes is shownin the state diagram which puts the lighthouse back in a state wherere-binding is necessary. The MAC address assigned is now consideredexpired.

The binding process is designed to obviate the need to assign static MACaddresses to simple devices of which there can be multiple talking to arobot at once. The assignment of addresses by the robot 104 can simplyamount to cycling through a list of valid addresses. If the assigned MACaddresses are to expire some time after the bind, it greatly reduces thechance that the user could cause a configuration error.

For example, if there were a procedure the user needed to follow toassign MAC addresses to the lighthouse 102 (e.g. install the batteries,place in front of robot, and hit button sequence on robot), he might dothis successfully for the two included in the initial package. If therobot 104 ever forgot the last one assigned due to a code update orsoftware problem, he might assign a conflicting address in the future ifthe user purchased an additional one later. Or, if the user replaces therobot 104 and then uses it to configure a new lighthouse, a conflict isvery possible. Having the lighthouse MAC addresses expire tends to healall such problems. One drawback to expiring addresses is that memoriesof what lighthouses the robot 104 encountered while cleaning areforgotten. These memories are potentially useful in having the robot 104clean different rooms, on different days. In either case, the age of aMAC address is specified in the “join accept” message giving the robot104 (hence future software revisions of the robot 104) the freedom tomake such decisions.

FIG. 9C shows the state diagram 960 for the remote control. The remoteis used to drive the robot 104 around program its schedule. The remotecontrol has a group address and does not require a numeric address.

From power saving state 962, the pressing of a button triggers seekingstate 934 and the search for robots on the common channel. The search isperformed at a very low power setting if the RPAN ID stored innon-volatile memory is blank. Otherwise, full power is used. In thisway, a robot in very close proximity will, respond to an unpairedremote. The search can be described by the following loop which isexecuted continually until a robot is found or until the remote putsitself back to sleep due to inactivity.

-   -   1. Operate radio on CSC responding to Activate Invite messages        (1 second).    -   2. Perform 1 active scan (360 milliseconds).

If the active scan collects responses, the remote moves to binding state936 and the robot with the highest signal strength is selected. Theremote switches to the robots channel and gets link by tracking thebeacon. It then sends a ping message to itself. If it gets, a response,then that means another remote control is using the group address. If noresponse is received, the remote is in active state 938 and is allowedto control the robot 104.

If the remote successfully communicates with the robot 104 on theoperational channel, that robots RPAN ID is programmed into the remotecontrols non-volatile memory. The remote control communicates with therobot 104 as long as it is awake and buttons have been pressed recently(60 seconds). If the beacon is lost for over 10 seconds which is howLink Down is configured on the remote, it tried to find a robot again.

A paired remote control can be unpaired by installing the batteries withthe left drive button depressed and keeping it held down for threeseconds. It is then paired as part of the robot discovery algorithmdescribed above.

Driving the robot 104 and operating its user interface remotely isaccomplished by sending button states to the robot 104 and receiving LEDstates from the robot 104. These are updated when they change as well asat a refresh interval. In this way, the remote can be thought of as adumb terminal.

The following describes the design of RF communications system for arobot system, such as the robot systems 100 and 200. The communicationssystem performs the following actions: wake to RF for lighthouses androbots, remote control and lighthouse beam control commands, low powerconsumes a low amount of power, occupies a small RAM/ROM footprint, codeand sound download, coexists with common interferers found in suchenvironments, coexists with other robot systems in proximity as will becommon in the mobile robot 104 development labs and some homeenvironments, provides a simple growth path at each layer of thenetworking hierarchy.

The RF communications stack to be used on the robot systems 100 and 200is discussed in a layer oriented approach starting from lowest andending with the highest. The approach is based on the seven layer OpenSystems Interconnection (OSI) Reference Model.

The physical layer uses the 2.4 GHz direct sequence spread spectrum(DSSS) modem as is specified in IEEE 802.15.4. The physical layersupports the following features: 16 available channels; energy detection(ED) provided on demand; clear channel assessment (CCA) using energy,carrier sense or both; and link quality indication (LQI) provided withpacket reception.

The MAC layer provides the ability for a device to transmit broadcastand uni-cast messages to other devices within radio range. This does notpreclude any topology from being supported in the future. However,layers above this MAC layer will impose restrictions. The MAC layersupports the following features: single master and multiple slaves,master sends beacon containing the beacon period and active period whichallows a slave device to track the beacon knowing when to listen andwhen to save power, slave tracks beacon to establish link status, mastercan be told by higher layers to listen on the network establishmentchannel during idle periods of the beacon, a 16-bit Robot Personal AreaNetwork Identifier (RPAN ID) to allow devices to filter packets not onthe robot network of interest when channel is shared, group identifierin addresses include allow broadcast to specific device types andobviate need for unique MAC addresses for many types of peripherals,collision avoidance algorithm using CCA and random back-off, andreliability through acknowledge, requests and automatic retry.

Including acknowledgement in the MAC layer was done for the IEEE802.15.4. This may bring the MAC layer up to par with wired media suchas half duplex Ethernet where collision detection can be used to givethe sender a high level of confidence that the packet arrived at thedestination. Network layer acknowledgement schemes may be needed whenbridges and routers between the sender and receiver have the potentialto drop packets due to resource constraints. Either MAC layer or networklayer acknowledgement can be made to suit the needs of this network.

The MAC layer acknowledge is time sensitive since there is no addressinginformation contained in the packet. If the acknowledgement is sent veryquickly, it is unlikely to collide with a new data packet or be confusedas an acknowledgement to the new data packet. The sequence numberreduces the chances of processing the wrong ACK.

An acknowledgement at the network layer is not as time sensitive sincethe packet contains addressing information. However, more time is wastedsending this extra information and the latency is worse as informationis passed between layers. More state information is potentially neededto remember which packets have not been acknowledged unless head of lineblocking is used.

Avoiding time critical processing of packets is not desirable, but theremay be situations in which, it is used. If another robot or an IEEE802.15.4 device is, operating on the same channel, the receiver may needto promptly parse and discard a valid packet not intended for it. To theextent it delays, it risks not listening when a packet intended for itis received. After factoring this in, it may be appropriate to includethe ACK and retry feature at the MAC layer and take steps to mitigatethe imposed real time constraints.

Again, an acknowledgement scheme implemented at the MAC or networklayers can be made to work. If the MAC layer proves problematic, due toany of the concerns expressed above, the acknowledgment scheme can beimplemented at the network layer.

The network layer is responsible for establishing membership in anetwork. The role of a master device and a slave device are different atthis layer. The network layer supports the following slave features:network discovery using low power active scanning on common channel, canissue requests to join a network using a temporary random MAC address,and can participate in a network without any joining transaction if MACaddress is known. The network layer supports the following masterfeatures: channel selection when network is started based on bestavailable channel, and management of join requests sent on the commonchannel including assignment of MAC addresses to slaves using temporaryones.

The 16 available channels are discussed in a zero based manner (0-15).Channel 4 does not get 802.11b interference in the USA or Europe. Assuch, it is chosen as the common signaling channel used for networkjoining procedures.

The defined MAC layer draws, on IEEE 802.15.4. Some concepts borrowedinclude the CSMA-CD algorithm, the reliability feature, and the beaconconcept to some extent. The PAN coordination features are replaced witha method more targeted to the more limited needs of the higher layers.

The MAC layer is based on the presence of a master who generates beaconswhich define a period of active communications during which any devicecan talk to a device. Slave devices track this beacon to determine ifthe robot is present and when it can save power. The mobile robot 104 isthe master device and is responsible for transmitting the beacon andmanaging slave devices. Slave devices track the beacon of the master sothey know, when they should listen for the next beacon, when they cancommunicate with other devices, and when they should turn off their RFmodems to save power.

The MAC layer header includes a field designed to conflict with the IEEE802.15.4 frame type field so that such a MAC device should reject it asan invalid frame type, and is otherwise designed to allow multiple RPANsto share a single channel. The RPAN ID field is in a fixed location inthe packet, so a receiver can filter on a particular RPAN much like aVirtual LAN (VLAN) in Ethernet.

Beacons are transmitted by a master at periodic intervals. One reason isto imbed information about when the slave devices should expect toexchange messages with the master. This duty cycle control allows somelevel of power saving even during active operational modes. The secondreason for transmitting beacons is to provide a constant status on theproximity of the robot. The goal is to unburden application layersoftware from doing this task.

A beacon is sent periodically as specified by the Beacon Period which isspecified in the beacon itself. So, a slave receiving a beacon knowswhen to expect the next one. An Access Period is specified in thebeacon, as well. This dictates the period of time during which themaster will be active on the channel. Slaves should pay attention duringthis time and may shut down their receivers at other times. The sequencenumber in the beacon allows the slave to detect one or more missingbeacons.

When a master specifies a small active period relative to the beaconperiod, it gives it the opportunity to spend the idle time listening onthe CSC to admit new peripherals into the network. As such, the beaconperiods may be set in a manner related to the period that peripheralsuse to wake up and try to join a network.

A typical beacon period may be on the order of a second. The jitter ofthe beacon message is relatively high considering the random nature ofthe back-off algorithm. Also, the slaves should not be burdened withhaving to manage events with a high level of temporal precision. Subjectto the clocking requirements discussed later, the slave should define a“beacon window” which is a time period centered on the next expectedtime a beacon will be received. The slave should listen for the beaconduring this window. The window ends when the expected beacon isreceived, ideally. If no beacon is received, the window ends, but theslave operates during the access period as, if it received one. When abeacon is missed in this way, the window is lengthened for the nextbeacon since clock inaccuracies add. Once too many beacons have beenmissed, a loss of beacon is declared and the slave just listensconstantly until it reacquires it. The loss of beacon condition isanalogous in the Ethernet world to losing link. The master transmitsbeacons with a time accuracy of less than 0.1%.

The MAC engine is based on a 250 microsecond process tick in order tosimplify the management of state timers and avoid busy waiting. Itshould be, a design goal of the implementation to insure that theprocessing in a single tick never exceeds 125 microseconds in order toleave plenty of processor available for other more critical tasks. In250 microseconds, 7.8 characters can be transmitted at the fixed baudrate of 250 kbps. Including the preamble and PHY header, the smallestpossible packet is 8 characters long. This means that two CCA functionsperformed in consecutive ticks will almost certainly detect an ACK inflight.

The collision avoidance algorithm is invoked whenever there is a packetready to transmit. The transmitter will delay a random number ofback-off periods before running the CCA function. On the tick where theCCA function has completed, the transmitter will start sending if theCCA returned saying that the channel is clear.

The dead time between a packet reception ending and art ACK starting isbetween one and two ticks. So, a CCA function that does its best toprevent stepping on the ACK is one which performs two CCA measurementsspaced a tick apart and declaring the channel clear if both pass. Theback-off period is designed to be longer than the transmission time of asmall packet such as an ACK, so two ticks is chosen.

If a data frame is received with acknowledgement requested with amatching destination address, the receiver prepares to send anacknowledge packet provided that it will be able to pass the bufferalong to the application. The receiver waits one tick to give the sendertime to switch its transceiver into receive mode, then transmits anacknowledgement which is the first 2 bytes of the MAC header echoed withthe frame type changed to an the ACK value. The sender expecting an ACKwill wait for up to five ticks (1.25 ms) to receive the reply beforeretrying the transmission. Up to three retries are performed. If anacknowledgement is requested, the sender should postpone sending thepacket if there is not enough, time remaining in the current activeperiod for the receiver to send the acknowledgement.

Data payloads in this network begin with the Transport Header whichconsists of a byte specifying the Service Access Point (SAP). Thismultiplexes different types of services onto the same device address.Previously, this has been accomplished using the “opcodes”.

Device Control, Device Status Request, and Device Status SAPs arerelated in that the payload messages use the same code points on a perdevice basis. That is to say that devices will have a published set ofcontrol and status information elements consisting of an element codefollowed by a known number of element payload bytes. If controllableover RF, the Device Control SAP is used to set values. Controllable andobservable items can be queried with a Device Status Request. The actualstatus is delivered using the Device Status SAP whether solicited, i.e.requested over the Device Status Request SAP, or unsolicited, i.e. sentspontaneously. Alarms and other indications may be delivered in thisway.

The reason to use multiple SAP codes for this related functionality isthat it may a major portion of the overall RF traffic. As such, thesmaller the packets can be made, the more reliable the transmission. So,for critical control and status messages, having a two byte header<Device_SAP><Control_Cmd> or <Device_SAP><Status_Cmd> keeps the PHY andMAC headers as small as possible.

“ROBOT OBSTACLE DETECTION SYSTEM”, U.S. Pat. No. 6,594,844, disclosingproximity sensors such as cliff sensors and wall following sensors;“AUTONOMOUS FLOOR CLEANING ROBOT”, U.S. Pat. No. 6,883,201, disclosing ageneral structure of an iRobot Roomba coverage/cleaning robot and mainand edge cleaning heads in detail; “METHOD AND SYSTEM FOR MULTI-MODECOVERAGE FOR AN AUTONOMOUS ROBOT”, U.S. Pat. No. 6,809,490, disclosingmotion control and coverage behaviors, including escape behaviors,selected by an arbiter according to the principles of behavior basedrobotics; and “METHOD AND SYSTEM FOR ROBOT LOCALIZATION ANDCONFINEMENT”, U.S. Pat. No. 6,781,338, disclosing virtual walls, i.e.,robot confinement using wall-simulating directed beams, are eachincorporated by reference herein in their entireties.

Other robot details and features combinable with those described hereinmay be found in the following U.S. patent applications filedconcurrently herewith, entitled “AUTONOMOUS COVERAGE ROBOT NAVIGATIONSYSTEM” having assigned Ser. No. 11/633,869; “MODULAR ROBOT” havingassigned Ser. No. 11/633,886; and “COVERAGE ROBOT MOBILITY” havingassigned Ser. No. 11/633,885, the entire contents of the aforementionedapplications are hereby incorporated by reference.

A number of implementations have been described. Nevertheless, it willbe understood that various modifications may be made without departingfrom the spirit and scope of the following claims. Accordingly, otherimplementations are within the scope of the following claims.

What is claimed is:
 1. A mobile cleaning robot comprising: a drivesystem to move the robot on a floor surface; a cleaning unit to cleanthe floor surface; an audio output device to emit audio content; adisplay system operable to present visual indications; a controllerconfigured to, in an operational mode, operate the display system topresent a first indicator indicative an operating state of the robot,the first indicator being indicative of one or more of a power state ofthe robot, a dormant state of the robot, a charging state of the robot,and a behavior of the robot, and in a training mode, operate the displaysystem to present a second indicator and operate the audio output deviceto audibly emit content in coordination with the second indicator toprovide a user with one or more of an audible tutorial, technicalsupport, a training program, instructions to demonstrate operationalfeatures of the robot, and instructions to interact with the robot. 2.The robot of claim 1, further comprising: a receiver to wirelesslyreceive data representing the content from a remote computing device,and a transmitter to wirelessly transmit data representing the operatingstate of the robot to the remote computing device.
 3. The robot of claim1, wherein the controller is further configured to operate the displaysystem to present the first indicator in accordance to an operativepattern corresponding to a state of the robot, operate the displaysystem to present the second indicator according to a training patternin timed coordination with the audibly emitted content, the operativepattern being distinct from the training pattern.
 4. The robot of claim1, further comprising a bin in communication with the controller,wherein the first indicator is indicative of information representing anamount of substance in the bin.
 5. The robot of claim 4, wherein the binis a consumable fluid bin, and the audibly emitted content includesinformation representing an amount of fluid in the bin.
 6. The robot ofclaim 1, wherein the controller is configured to receive a customizationselection indicative of one more of audible content, visual content,multimedia content, a choreographic routine, or a movement routine, andoperate the robot based on the customization selection.
 7. The robot ofclaim 1, wherein the controller is configured to navigate the robotacross the floor surface based on signals from a camera.
 8. The robot ofclaim 1, wherein the display system includes an illuminable maintenancedisplay substantially mimicking an appearance of the robot.
 9. The robotof claim 1, further comprising a microphone configured to receive anaudible command for a function performable by the robot, and thecontroller is configured to use speech recognition to cause the robot toperform the function provided by the received audible command.
 10. Amobile cleaning robot comprising: a drive system to move the robot on afloor surface; a cleaning unit to clean the floor surface; an audiooutput device to emit audio content; a display system operable topresent visual indications; a controller configured to, in a trainingmode, operate the display system to present one or more indicators andoperate the audio output device to audibly emit content in coordinationwith the presented one or more indicators to provide a user with one ormore of an audible tutorial, technical support, a training program, andinstructions to demonstrate operational features of the robot.
 11. Therobot of claim 10, further comprising: a receiver to wirelessly receivedata representing the content from a remote computing device, and atransmitter to wirelessly transmit data representing an operating stateof the robot to the remote computing device.
 12. The robot of claim 10,wherein the controller is further configured to operate the audio outputdevice to instruct the user to interact with the mobile cleaning robot.13. The robot of claim 10, wherein the controller is further configuredto operate the display system to present the one or more indicatorsaccording to a training pattern in timed coordination with the audiblyemitted content.
 14. The robot of claim 10, wherein, in an operationalmode, the controller is configured to operate the display system topresent an indicator indicative of an operational state of the robot.15. The robot of claim 14, wherein the indicator is indicative of apower state of the robot in the operational mode.
 16. The robot of claim14, further comprising a bin in communication with the controller,wherein the indicator is indicative of information representing anamount of substance in the bin.
 17. The robot of claim 16, wherein thebin is a consumable fluid bin, and the audibly emitted content includesinformation representing an amount of fluid in the bin.
 18. The robot ofclaim 10, wherein the controller is configured to receive acustomization selection indicative of one more of audible content,visual content, multimedia content, a choreographic routine, or amovement routine, and operate the robot based on the customizationselection.
 19. The robot of claim 10, wherein the controller isconfigured to navigate the robot across the floor surface based onsignals from a camera.
 20. The robot of claim 10, wherein the displaysystem includes an illuminable maintenance display substantiallymimicking an appearance of the robot.
 21. The robot of claim 10, furthercomprising a microphone configured to receive an audible command for afunction performable by the robot, and the controller is configured touse speech recognition to cause the robot to perform the functionprovided by the received audible command.